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SUNIARY 

Derivation  of  the  theoretical  autocovariances  of  an  ARMA  Model  Is 
iMportant  for  a  number  of  purposes  associated  with  the  estimation  and  testing 
of  the  model.  One  common  algorithm*  due  to  McLeod  (1975).  Involves  solving  a 
system  of  linear  equations.  By  deriving  the  determinant  of  the  matrix  of 
coefficients  In  these  equations  we  can  ascertain  the  behaviour  of  the  algorithm 
with  respect  to  the  statlonarlty  of  the  ARMA  model. 
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McLeod  (1975*  1977)  presents  a  method  for  deriving  the  theoretical  auto* 
covariance  function  of  an  ARNA  model.  He  notes  Its  uses  In  simulating  ARHA 
processes  and  In  deriving  the  asjnuptotlc  distributions  of  the  estimated  auto* 
correlations.  The  procedure  can  also  be  used  In  deriving  ARMA  model  residuals 
(Ansley  and  Newbold,  1979);  In  obtaining  the  asymptotic  distributions  of 
parameter  estimates  and  residual  autocorrelations  (McLeod.  1978);  and  In 
calculating  the  exact  likelihood  function  of  the  Gaussian  ARMA  model  (LJung 
and  Box.  1979;  Ansley.  1979;  and  Dent.  1977).  Ansley  (1980)  and  Ansley  and 
Kohn  (1982)  have  also  extended  McLeod's  algorithm  to  vector  ARMA  models. 

An  alternative  and  computationally  superior  procedure  to  McLeod's  In  the 
univariate  case  has  been  proposed  by  Wilson  (1979).  It  also  has  the  advantage 
that  the  statlonarlty  of  the  process  may  be  tested  directly  within  the 
algorithm  generating  the  autocovariances.  The  procedure  for  maximum  llkell* 
hood  estimation  proposed  by  Dent  (1977)  also  Incorporates  a  test  of  station* 
arlty.  as  do  some  others  In  that  a  Cholesky  decomposition  of  the  generated 
covariance  matrix  Is  later  derived.  However,  this  Is  not  general. 

The  purpose  of  this  note  Is  to  examine  the  behaviour  of  the  McLeod 
algorithm  with  respect  to  statlonarlty. 

Consider  the  ARMA(p.q)  process  (X^)  given  by 

^t  "  ^l^t*l  ”  •••  “  ^p^t*p  *  *t  ”  ®l*t-l  ”  •••  "  ®q*t*q  * 

If  p  ■  0  >  the  process  Is  always  stationary.  If  p  >  0  the  process  Is 
stationary  If  and  only  If  the  roots  of  the  polynomial  equation 

I  •  0  (2) 

k*0  * 

all  lit  within  the  unit  circle.  For  later  reference,  denote  the  roots  of  (2) 

P  k 

By  •  and  denote  the  polynoirtal  I  e^z  by  a(z)  . 


If  p  >  0  tiM  v«r1«nc0  and  the  first  r  autocovariances  > 

where  r  •  Mx{p,q),  are  obtained  by  solving  a  syste*  of  linear  equations. 

The  Mtrix  of  coefficients  of  these  equations,  A  sayt  Is  given  in  McLeod 
(1975)  and  LJung  and  Box  (1979).  Our  Interest  Is  In  how  the  statlonarlty  of 
(1)  affects  the  solution  of  these  equations.  We  determine  this  by  expressing 
|A|,  the  determinant  of  A  ,  In  terms  of  the  roots  of  (2). 

Consider  the  matrix  A(t)  obtained  by  replacing  by  ^^t^  In  A  . 
The  1^^  row  of  A(t)  may  be  expressed  as  the  sum  of  two  row  vectors,  thus: 


^  (0,^^t  , . . . ,^pt^,0 ,. . .0)  ,  1  *  1 ,2 , . . . ,r^l  . 


Clearly,  £^1^  ■  ♦(t),  for  1  •  l,2,...,r4-l,  where  £  Is  the  unit  vector 
(1,1 . 1)'.  Hence,  f(t)  Is  an  eigenvalue  of  A(t)  and  so  a  factor  of 


|A(t)|.  Similarly,  4(ot)  Is  a  factor  of  |A(t)|.  We  may  note  for  later  that 
♦(t)9(-t)  «  f  (l-z?t^)  . 

1-1  ^  _ 

Suppose  z(#tl)  Is  ar^  solution  of  (2),  and  c  ■  (l,z,...,z  )'  .  We  can 

P+1-1  * 

use  (2)  to  write  a.c  in  the  form  >  ^*4 (*''-*  '')  •  1  -  l,2,...,r+l  . 

j-1  , 

Note  that  If  r  •  p  ,  a^^  *  0  .  Suppose  now  that  z~^  Is  also  a  solution  of 
(2),  and  »  (l,z"^,...,z"^)'  .  Then,  A(jj;«£j)  ■  0  which  Is  possible  If 


and  only  If  A  Is  singular.  Thus,  (1-z^Zj)  Is  a  factor  of  |A|.  Further, 

If  Is  replaced  by  f^t^  In  (2)  the  roots  become  (tz^  :  1  ■  1,2 . p)  , 

2 

and  we  can  deduce  that  (l-z.z.t  )  Is  a  factor  of  |A(t)|.  Thus, 

P  P  9 

P(t)  •  n  ■  (l-z.z.t^)  Is  a  factor  of  |A(t)|. 

1-1  J-1  ’  ^ 

Note  that  P(t)  Is  a  polynomial  of  degree  p(p^l)  In  t  .  If  r  -  p  , 


the  (lc,p+2-k)th  element  of  A(t)  has  the  form  (^^t^  *  terms  of  lower  power) 
f  or  k  •  l,2,...,p+l  •  Thus,  lA(t)|  Is  also  a  polynomial  of  degree  p(p+l)  • 
If  r  -  q  then  A(t)  has  the  form 


2 


Ap(t)  0 

A(t)  - 

B(t)  L(t) 

where  L(t)  Is  a  lower  triangular  matrix  with  units  along  the  main  diagonal. 
Thus,  |A(t)|  «  |Ap(t)|  and  A^Ct)  Is  (p+l)  x  (p-t-l)  and  has  the  property 
ascribed  to  A(t)  when  r  •  p  .  Hence,  In  both  cases,  |A(t)|  Is  a  polynomial 
In  t  of  degree  p(p'>-l)  .  Further,  |A(0)|  «  1  <■  P(0)  .  Thus,  taking  t  ■  1, 
we  have  shown  that 

|A|  -  5  n  (1-z.zJ  (3) 

1-1  j-1  ' 

where  Z|,Z2 . z^  are  the  solutions  of  (2). 


3 


CONaUSIONS 

Fran  (3)  It  Is  clear  that  |A|  >  0  If  and  only  If 
either  (1)  there  Is  a  root  on  the  unit  circle; 

or  (11)  there  are  a  pair  of  roots  symetric  about  the  unit  circle,  I.e. 

2  and  2“'  . 

It  Is  comforting  to  knoM  that  the  procedure  will  fall  and  no  auto¬ 
covariances  will  be  generated  when  the  process  Is  non-statlonary  for  either  of 
the  reasons  given.  On  the  other  hand.  It  Is  clear  that  a  non-statlonary 
process  which  does  not  satisfy  either  (1)  or  (11)  will  yield  a  set  of  "auto- 
covariances".  It  may  be  possible  to  detect  this  at  once,  e.g.  may  be 
negative  or  less  than  In  magnitude  for  some  k  .  In  general,  however, 
these  values  can  be  shown  to  be  spurious  only  by  showing  that  the  correspond¬ 
ing  covariance  matrix  Is  not  positive  definite. 

This  may  be  achieved  In  a  routine  manner  within  the  overall  procedure. 
Dent  (1977)  suggests  a  check  on  the  singular  value  decomposition  of  the  co- 
variance  matrix  and  Pagano  (1973)  discusses  a  modified  Cholesky  decomposition. 
However,  If  the  purpose  of  the  procedure  Is  estimation  we  may  have  to  generate 
autocovariances  from  different  sets  of  parameters  a  large  number  of  times.  In 
such  a  case  an  algorithm  such  as  that  proposed  by  Ml Ison,  which  checks 
statlonarlty  while  It  generates  autocovariances,  would  clearly  be  preferable. 
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